DOCUMEKT RESUME 

ED 320 932 TM 015 151 



AUTHOR 
TITLE 

PUB DATE 
NOTE 



PUB TYPE 



Green, Suzy A. 

Power Analysis in Repeated Measures Analysis of 
Variance with Heterogeneously correlated Trials, 
Apr 90 

41p.? Paper presented at the Annual Meeting of the 
American Educational Research Association (Boston, 
MA, April 16-20, 1990) . 
Reports - Evaluative/Feasibility (142) — 
Speeches/Conference Papers (150) 



EDRS PPICE 
DESCRIPTORS 



IDENTIFIERS 



MF01/PC02 Plus Postage. 

* Analysis of Variance; ^Correlation; Data Analysis; 
Effect Size? *Estimation (Mathematics/; *Test 
Interpretation 

Heterogeneity of Variance; *Power (Statistics); 
•Repeated Measures Design 



ABSTRACT 

The issue of power in exploratory single group 
repeated measures analysis of variance is explored under the 
condition of heterogeneous correlations across the repeated measures 
trials. Tables developed from 13 real and hypothetical data sets (70 
cells) show how well both univariate and multivariate power is 
estimated unaer a variety of conditions of non-sphericity and effect 
sizes. It was shown that a reasonable estimate of power could be 
obtained based on the mean off -diagonal population correlation and J. 
Cohen's (1965) estimate of effect size for a one-way analysis of 
variance, ix. was recommended that researchers base their ostimates of 
this mean population correlation on what they know about their 
instrument's test/ret jst reliability under treatment conditions, one 
data table and nine figures are included, one appendix lists the 
sources cf the data sets, and another appendix provides a computer 
program for estimating power. (Author/SLD) 
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Abstract 

The study ej^lores the issue of power in exploratory single 
group repeated measures analysis of variance under the condition 
of heterogeneous correlations across the repeated measures 
trials. Tables developed from real and hypothetical data sets 
show how well both ijinivariate and multivariate power is 
estimated under a variety of conditions of non-sphericity and 
effect sizes. It was shown that a reasonable estimate of power 
could be obtained based on the maan off-diagonal population 
correlation and Cohen's estimate of effect size for a one-way 
analysis of variance. It was recommended that researchers base 
their estiiflate of this mean population correlation on what they 
know about their instrument's test/retest reliability under 
treatment condition; 
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Power Analysis in Repeated .Nfeasures Analysis of 
Variance with Heterogeneously Correlated Trials 

Introduction 

The study ejqjlores the issue of power in repeated measures 
analysis of variance under the condition of heterogeneous 
correlations between the repeated measures trials. Tables 
developed from real and hypothetical data sets show how well 
both univariate and multivariate power is estimated under a 
variety of conditions of non-sphericity and effect sizes. The 
question of interest is: How well is the repeated measures 
effect size estimated when a single correlation coefficient is 
used as a population parameter to represent the correlations 
among the repeated measures when the correlation matrix is 
heterogeneous in a single group ejqDloratory design? This 
question breaks into two main points: (a) If we use a single 
estimate for p, will it provide a good estimate of population 
power?, and (b) What should be used for the single estimate? 
The paper continues with background perspectives on the 
findings, methods, results, the development of the question of 
interest, conclusions, the ilnportance of the study, and tables 
supporting the findings. 

Background and Perspectives 

Power analysis has been studied for several statistical 
procedures. However, the iitportance of a priori determination 
of the probability that a statist? cal test will yield 
statistically significant results has not been in evidence in 
the literature (Cohen, 1988). Cohen's text gives many 
examples of power calculations for various .search designs. 
However, it does not include power computations and tables for 
repeated measures analysis of variance designs except in its 
most basic form, the dependent t test. This area has been 



ERIC 



4 



Power Analysis 
4 

explored in part (Barcikowski & Rotxy, 1985, 1984a, 1984b, ard 
Robey & Barcikowski, 1984) , yet the impact on power under the 
specific condition of heterogeneity of the occasions 
correlation matrix has not been throughly addressed. This 
study will attempt to determine whether a single 
representative estimate of a heterogeneous trials matrix will 
be adequate for use with current power analysis methods. 

tfrider valid assumptions (sphericity/circularity and more 
stringently, under uniformity, or constant correlations among 
the repeated measures trials) the exploratory single-group 
univariate F test is always more powerful than the 
multivariate F test, due to the great.er number of dencndnator 
degrees of freedom in the univariate test when epsilon, e, is 
equal to one. Under most circumstances, in an exploratory 
design, the assumption that sphericity is tenable is unlikely 
to be upheld. In univariate repeated measures analyses, a 
routine method to ccmpensate for the violation of the 
sphericity assumption is the use of an adjusted univariate F 
test to control the risk of type I error. The adjustment 
consists of estimating the sphericity parameter, e, and then 
multiplying the numerator and denominator degrees of freedom 
by the estimated e. The critical F value is then found using 
the adjusted degrees of freedom. Of the two estimates of e, 
recomnnended by Greenhouse and Geisser (1959) , and e~ 
recommended by Huynh and Feldt (1976) , is the more 
conservative and therefore is well put to exploratory ciesi<jns 
in which the value of e is probably unknown. 

When the sphericity assumption is violated, then the power 
of the adjusted univariate test varies from being more 
powerful than the multivariate test to being severely less 
powerful than the multivariate test (Barcikowski and Robey, 
1984a; Jensen, 1982) . Therefore, Barcikowski and Robey 
recommend the use of both tests. 

5 
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Cohen (1965) describes power as a function of the 
significance criterion, alpha; sanple size, n; and effect 
size, f, the degree to which a phenomenon is specific and 
nonzero in the population. Barcikowski & Robey (1985) 
modified Cohen's effect size categories (small, medium, 
large), based on an equation involving a single estimate of 
the intercorrelations among repeated measures trials. 
Barcikowski and Robey suggest when heterogeneous correlations 
are found among the occasions in repeated measures designs, 
that the iatraclass correlation coefficient might be used to 
represent the population trials correlation matrix in the 
calculation of effect size to estiinate power (1955, p. 7). 

Stevens defines the intraclass correlation, p, as 
dependence among observations, v^ich increases type T error 
rate (1.986, p. 202) . Haggard (1958) defines p as the 
correlation between every pair of manbers in the group. 
Others similarly defining intraciass correlation are Pearson 
(1901), Harris (1913), Fisher (1950), and Winer (1971). 

Two other measures of a single estimate to represent the 
trials correlation matrix are the mean of the off-diagonal of 
the correlation matrix, and the median off-diagonal. While 
not the same as an intraclass correlotion, central tendency 
measures are routinely used to represent sets of numbers. 
Here, tliese two measures are determined fron the correlations 
between the occasions. 

Development 

Mean Vec:tors and Variance-Cova riance ^4at rices 

The development of the analysis began with contrived data 
from Willhoft and Schafer (1989) . They combined five patterns 
of mean vectors, representing models of growth and learning 
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over tiire, with variance-covariance matrices with three levels 
of sphericity: spherical (e^ = 1.00), rxearly spherical (e'^ = 
0.95), and moderately spherical (e'" = .75) . Willhoft and 
Schafer state that one factor affecting both univariate and 
multivariate power in repeated measures designs is the 
"interaction between the way in which the . . . 
repeated- factor means are ranked, that is, the 'shape' of the 
mean vector, u, and the way in which the . . . elements of S 
[the variance-covariance matrix] are arranged" (p. 2) . 

Extending some of the examples of Willhoft and Schafer 
(excluding the three "no growth" patterns of all zeros in the 
mean vector), 58 other pattern combinations of mean vectors 
and variance-covariance matrices from real and hypothetical 
data sets (Appendix A) weie examined. Those sets of raw data 
were first analyzed using the Repeated Analyzer SAS language 
program (SAS Institute Inc., 1985) created by Barcikowski and 
Pobey (1990) . From tMs program, mean vectors, y; 
variance-covariance matrices, 2; sample sizes, n; number of 
trials, k; and the non-singular matrix of (k - 1) by k 
contrast coefficients, C were catalogued. This information 
was entered into the SAS language program Fho Effect (Appendix 
B) based on equations in Barcikowski and Robey (1984a, 1985) . 

Effect Si7.e 

In their paper (1985) , Barcikowski and Robey show that when 
the conc'ition of uniformity-'- is riBt, Cohen's effect size 
index, f, may be written in both the univariate (f^) and 

multivariate (f^^j) form as: 

(1) fu = fm = f /^l - P 
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where p is a population correlation, such as the intraclass 
correlation coefficient. Specifically, the univariate and 
multivariate effect sizes under uniformity are: 



This equation is Cohen's (1988, p. 275) effect size for a 
one-way analysis of variance with K independent groups divided 
by yjl - p. For the purpose of repeated measures analysis of 
variance, K equals the number of trials in a single group 
design. The numerator of this formula can found as the sum of 
squares between measures in a one-way analysis of variance. 
In the denominator, can be found as the population 

variance for any given measure. In practice, o^^ and p are 

estimated from nom information or from past research/pilot 
work. 

In an ejqDloratory analysis, p is an unknown quantity, and 
difficult to estimate if homogeneity between the repeated 
measures trials correlation matrix cannot be assumed. Under 
the limitation of ccnpound symnetry, formula (2) can be used 
to calculate effect size which is used to calculate power. 
Actual power is calculated using the interaction of 

units and measures, or the error, variance, vdiich can be 
estimated as the mean square within residual in a reliability 
program analysis (e.g., SPSS^ RELIABILITY) . Under the 
condition of circularity. 



(2) fu = fm=/ ^ -^^-J^ 








<3) cx^^ (1 - P) 
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Formula (2) employs the estimate of o^^ (1 - p) in the 
dencminator. Tne effect size calculated may be over- or 
underestimated using a single estimate of p. The answer to the 
question of interest rests on the magnitude of the over- or 
underestimation . 

Methods 

Data Sets 

Seventy cells were catalcxgued fron 13 data sets. Six data 
sets came from published sources, some real, some 
hypothetical. The remaining data sets were collected from 
practitioners at Ohio University in Athens, OH, and were all 
real data. The studies came frcm a wide variety of 
disciplines, such as hearing and speech sciences, botany, 
interpersonal conmunication, curriculum and instruction, and 
osteopathy. While most of the practitioners' data sets were 
exploratory, only two were single group designs. The analyses 
were performed on each group separately, as if each were a 
single group. Tfie same procedure was followed when there was 
more than one measure per occasion. Only one measure was 
analyzed at a time. The hypothetical data sets were separated 
the same way. 

Prncediire 

The Rho Effect program was used, to calculate the parameters of 
interest. Using information frcm the Repeated Analyzer 
program, among the measures that were calculated are the 
following: (a) PBAR, the average of the lower triangular half 
cf the trials correlation matrix; (b) PNED, the median of the 
lower triangular half of the trials correlation matrix; 

(c) MES_POP, the multivariate effect size in the population; 

(d) UESJPCP, the population univariate effect size; 
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(e) ES_iyEAN,the effect size estimate based on RBAR; 

(f) ES_NED, the effect size estimate based on RMED; 

(g) MPOP_PCW, multivariate population power; (h) UP(P_POW, 
univariate population power; (i) iyEAN_PCW, multivariate power 
estimated from RBAR; (j) MED_PCIW, multivariate power estimated 
from RMED; (k)UiyEANPCW, univariate power estimated from RBAR; 
and (1) uyiED_PCW, univariate power estimated from RMED. 

Intraclass correlation coefficients were not included in 
the final Rho Effect program. Several intraclass correlation 
coefficient formulas were investigated (Harris, 1913; Fisher, 
1950; and Winer, 1971) , but the resulting effect sizes tended 
to be so large, both in absolute terms and in conparison to 
population values, as to be useless and so were discarded. 

As there was a varied mixture of real and hypothetical data 
sets, the analysis of how well power is estimated was 
descriptive in nature. The Microsoft Works for ;^le 
Macintosh Systsns spreadsheet (Productivity Software Inc., 
1988) was used to build the database of the vciriables. 
Corparisons were made of population parameters vs. derived 
estimates for p, f, and power. Statpro (Penton Software Inc., 
1985) was used for graphics. 

Results 

Table 1 lists coirparisons of p, f , and power. The 
cotiparisons over tne 70 data set cells are: (a) ISUMI, the 
sum of the absolute value of the differences to detect the 
magnitude of the deviation; (b) \i, the mean of the absolute 
value of the deviations; (c) o, the standard deviation of the 
absolute value of the deviations; (d) % OYER, the percentage 
of analyses that overestimated the population parameter; 
(e) % SAIVE, the percentage of analyses that exactly estimated 
the population parameter; and, (f) % UNDER, the ^^ercentage of 
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analyses that underestimated the population parameter. 

The first entry in Table 1 conpares the p (RPCP) of the 
population (which was calculated from formula 4) with the mean 
r of the correlation trials matrix. The second entry ccmpares 
p to the median r of the correlation matrix. The comparison 
of these two entries shows that the mean r is a better 
estimator of p, in that the difference of Ip - r| has a 
smaller mean and variance. Both the mean r and the median r 
tend to overestimate p. Ficfure 1 depicts the range of 
deviations of RBAR and RMED fron RPOP. It is easy to see that 
RyED deviated from RPCP much more than did RBAR. The range 
bar plot for the mean r deviation shows it to be the nore 
accurate estimator of rho, with checkpoints at the minimum 
deviation score, 25th percentile, median, and maximum 
deviation score. 

The third through sixth entries in Table 1 ccmpare 
univariate and multivariate population effect sizes with 
estimates of effect size based on mean r and median r. 
Comparison of the third and fourth entries show that 
univariate effect size calculated using mean r is a closer 
estimate of the population parameter than using median r. As 
in estimating p, both estimates tend to overestimate the 
population effect size. Visual support for these findings are 
in Figures 2 and 3. These figures contain histogram frequency 
categories with ten range intervals. The tenth interval on 
Figure 2 and the eighth interval on Figure 3 contain zero 
(indicating the closest estimation of a parameter) . ES_MEAN 
(Figure 2) as an estiinator falls into this "best fit" interval 
surrounding zero 74% of the time coirpared to ESjyED which fits 
into the interval (Figure 3) 52.8% of the time. Both figures 
are negatively skewed, indicating that both ES_MEAN and ES_MED 
tend to overestimate UES PCP. 
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Entries five and six in Table 1 show first that mean r and 
median r estimate univariate effect sj.ze at least 300% better 
than they estimate multivariate effect size. In other words, 
the deviations of |SUM|, and o, of mean and median effect 
size from multivariate population effect size are over three 
times greater than the univariate ccrrparisons . However, 
within this category, the median r is the better estimator. 
Again, both tend to overestimate the parameter. 

Entry seven conpares two population parameters, and 
indicates which has more power: univariate or multivariate. 
Forty-three percent of the time, univariate population power 
is greater, compared to the 24% of the time that multivariate 
power is greater. 

Entries eight through 13 ccnpare population power 
parameters to estimated power. Entry eight vs. nine shows 
that univariate power based on mean r deviates from population 
power less than that based on median r. Univariate mean power 
also over- and underestimates less often than univariate 
median power. Figures 4 and 5 show the overestimation in the 
negatively skewed histograms. In the univariate mode, 
UMEANPCW fits into the inten/al containing zero 90% of the 
time (Figure 4) compared to the UMED_POW's 85.7% (Figure 5) . 
The deviations of the multivariate calcjlations tend to be 
larger than the deviations of the univariate calculations. 
Figures 6 and 7 show that while MEAN_POW and MED POW tend to 
more equally over- and underestimate multivariate power, i.e., 
the frequency graphs show a more "normal" distributional 
shape, that neither fits into the interval containing zero as 
often as the univariate estimators do. That is, MEAN_POW fits 
into the "zero" interval 75.5% of the time (Figure 6) and 
MED_PCW (Figure 7) fits into the interval 65.7% of the time. 
In Table 1, the multivariate carparisons (entries 10 and 11) 
likewise support the evidence that the riBan r is a more 
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accurate estimator than the median r in deriving power. 
Deviations of the median r are several times greater than 
deviations of the meari r. Entries 12 and 13 show that 
crossovers between univariate and multivariate parameters and 
estimates fare less will than non-crossover deviations. 

Entry 14 compares the multivariate and univariate mean r 
power estimates. The sample shows univariate mean power as 
the greater 63% of the time, and the lesser only 1% of the 
time. This ccrrparison echoes that of entry seven showing the 
same balance of results as the population values. 

Entries 15 and 16 corrpare the maximum population pOfier per 
cell (multivariate or univariate, whichever is gioater) with 
univariate mean power and multivariate mean power. UMEANPOW 
appears to approximate maximum population values more closely. 
Figures 8 and 9 show that 82.8% of the time UyEANPOW estimates 
the parameter within the interval containing zero (Figure 8) . 
In Figure 9, LMED_PCW fits into that interval only 54% of the 
time. 

Conclusions 

;.^ttedly, a weakness of the analysis is that with 70 
cells storming from 13 data sets, cells are related. However, 
this ej^loratory analysis of the question of interest turned 
up very consistent results, despite the wide variation in the 
nature of the studies across data sets. The first mai.i point: 
If we use a single estimate for p, will it provide a good 
estimate of population power?, can be answered affirmatively, 
based on the small magnitude of many of the deviation scores 
and other information in Table 1 and the corresponding 
figures. As to the second main point: What should the 
estimate be (e.g., mean r, median r)?, in this sanple of 
cells, it was shown that the mean r is the better estimator of 
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p/ f * and power ^ particularly in the univariate mode. A 
caution in the use of mean r as an estimator is that it tends 
to overestimate the parameters. However^ this single estimate 
can be used with Barcikowski and Robey's (1985) sanple size 
tables for a single groijp repeated measures analysis of 
variance. 

Another option to the question of the second main point on 
the choice of the estimate lies in the type of correlation 
coefficient used. An applicable correlation coefficient for 
the purpose of determining a single estimate of the 
correlations among heterogeneous trials might be test/retest 
reliability estimates. This type of correlation coefficient 
is based on testing the same examinees twice with the same 
test and then correlating the results . Repeated measures 
designs and test/retest reliabilities share "hazards" such as 
carry-o^/er and practice effects^ changes in subjects' degree 
of information and/or ability between trials^ and 
time-interval effects (Allen and Yen, 1979) . 

In practice, a researcher may have a priori access to a 
measure of the test/retest reliability of an instrument. 
There are two serious cautions to this suggestion, however. 
First, these "hazards" may result in an over- or 
underestimation of the true p. Second, actual test/retest 
reliabilities are not s\±)ject to treatment effects as might be 
applied in a repeated measures design. Any type of systsnic 
treatment errployed between trials might hax'e the effect of 
Ic* ering p.^ The reported test/retest reliability might, a 
priori, be viewed, conservatively as an upper bound of p, the 
degree to which rests on tiie effects of the treatme^ js on the 
subjects. 
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Reccmmpn datinns 

When a researcher is trying to determine a priori which r 
to use to estimate power, there are three routes that may 
assist : 

1. Use Barcikowski and Robey (1985, Table 1, p. 7) effect 
sizes alone. This route is best employed when the researcher 
has little or no information about the characteristics of the 
population from which the sample was drawn, such as in an 
exploratory design. One can conservatively chose a small 
effect size assuming a small correlation between measures, or 
try any of eight other effect sizes based on small, medium, 
and large correlations for use in Barcikowski and Robey 's 
sample size for power tables. When no other information is 
available a priori, the most conservative effect size will 
afford the largest sample size in order to detect significant 
differences . 

2. Use Formula (1) with Cohen's effect sizes and a 
reliability estimate for p. This route works best when, 
although the researcher may not know much about the actual 
characteristics of the population, the researcher is cognizant 
of issues that may affect the estimate of p. Perhaps the 
researcher has a reliability coefficient from a test reviewer 
reference, but plans to saiple a very smaJ.l group. Then the 
researcher would consider the referenced reliability 
coefficient as an upper bouiid for that sample. The researcher 
would also reed to assimilate information c\bout administration 
and sampliiig error into the determination of an estimate for 
P- 

3. Use Formula (2) with norr. information for o^^ ^^^^ p g^^^ 
consider different mean patterns. This route requires 
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knowledge about the population characteristics as well as 
issues concerning reliabilities. In an e^loratory analysis^ 
it would not be usual for the researcher to have this much 
infonnation prior to conducting the study. 

For an exploratory single group repeated measures analysis 
of variance design, when seme knowledge about the instrument's 
test/retest reliability under treatment conditions can be 
obtained, the reseacher will have reasonable results 
estiirating power using route #2. For all the routes, a 
researcher using a single estimate of p will also need to make 
a knowledgeable decision about which degrees of freedom to 
erploy. This stucfy shows that the univariate test using an 
estimate of p is more powerful than the multivariate test. 
Using the univariate degrees of freedom with the univariate 
test would give more accuracy in estimating population 
univariate power. However, an informed researcher may choose 
to use the multi^^ariate denominator degrees of freedom, i.e., 
(N-K+1) vs. the univariate (N-1) (K-1) , to arrive at a 
conservative sample size. 

Inportance of the Study 

The development of sample size/power tables in e^qDloratory 
single group repeated measures analysis of variance when the 
trials correlation matrix is heterogeneous addresses an issue 
not throughly researched. In ejq^loratory designs it is most 
likely the case that correlation matrices are heterogeneous 
rather than uniform. A method for estimating effect size in 
single group repeated measures analyses will assist 
researchers and practitioners in estimating a priori the power 
of their designs. 
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Footnotes 

-'■Using a single estimate of p is tantamount to assuming 
uniformity. However, this does not change the basic question 
of whether or not a reasonable estimate of power can be found 
using a single representation of a heterogeneour correlation 
trials matrix. 

"^However, if the treatment has a linear effect between 
measures, i.e., no interaction betweeen treatments and 
subjects, then the use of the reliability as an estimate seems 
reasonable. 
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Table 1 



Suimiary Statistics for Selec±e d Differences Scores 



VAR IABLE 

1) RPOP-RBAR* 

2) RPOP-RMED* 

3) UESPOP-ESMEAN* 

4) UESPOP-ESMED* 

5) MESPOP-ESdIEAN 

6) MESPOP-ESMED 

7) MPOPPOW-UPOPPOW 



I 3U M I u 2 

2.4396 .0348 .0610 

3.8711 .0553 .0681 

3.1506 .0450 .0<?68 

3.8689 .0552 .0777 

12.9866 .1855 .2153 

12.517 .1788 .1991 

5.4239 .0774 .1338 



8) UPOPPOW-UMEANPOW* 1.3801 .0197 .0650 



9) UPOPPOW-UMEDPOW* 

10) MPOPPOW-MEANPOW* 

11) MPOPPOW-MEDPOW* 

12) UPOPPOW-MEANPOW 

13) MPOPPOW-UMEANPOW 

14) MEANPOW-UMEANPOW 



2.0225 .0288 .0865 



4.6416 
22.0883 
29.0947 
5.6543 
3.0632 



.0663 .1283 

.3155 2.1465 

.4156 2.079 

.0807 .1307 

.0437 .0575 



15) MAXPOPPOW-UMEANPOW* 2.5143 .0359 .1082 

16) MAXPOPPOW-MEAICPuw' 4.4659 .0637 .1178 
* See figures for more ciot=>il. 



% % % 

OVER SAME UNDER 
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70 
71 
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61 

61 

43 

37 

44 

38.5 
38.5 
8.5 

49 
63 
23 
09 



10 

06 
17 

06 

06 

06 

33 

56 

44 

38.5 
38.5 
38.5 
34 

36 
56 
37 
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24 
12 
24 
33 
33 
24 
07 
12 
23 
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53 
17 
01 
21 
54 
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FIGURE 1 
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rpcip-rmed 70 0.49330 

25th 75th 
"iri!*^!' r!!""*'^* Median Percentile Ma-xmum 
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FIGURE 2 




Histogram Frequency Results for Field #25M3 - 14 
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FIGURE 3 
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FIGURE 4 
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FIGURE 8 
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FIGURE 9 
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i^^pendix B 
RhQ Effect 

★ 

THE EOIJmCNS PROGRAM WAS WRITTEN BY ROBERT S. BARCIKOWSKI AND 

SUZY A. GREEN DURING FALL 1989 AND WINTER 1990. IT IS BASED ON 

EQUATIONS IN BARCIKOWSKI AND KBEY (1984, 1985); 
★ 

★ 

★ 

★ 

★ 

DATA FISHER; 

* FISHER IS AN ITERATIVE SEQUENCE CF STATEMENTS THAT RETURNS 
THE F VALUE REQUIRED FCR SIGNIFICANCE GIVEN, Dl, D2, AND 
ALPHA. 

ALPHA = .05; * THE LEVEL OF SIGNIFICANCE; 

N = 25; * NUMBER CF UNITS; 

K = 5; * NUMBER OF MEASURES; 

F = 1; * STARTING NUMBER FOR F; 

Dl = K-1; * NUMERATOR DEGREES OF FREEDCM; 

UD2 = (N-1)*(K-1); * UNIVARIATE DEGREES OF FREEDCM; 

MD2 = N-K+1; * MULTIVARIATE DEGREES OF FREEDCM 

* THE FOLLOWING LOOP DETERMINES THE F VALUES 

DO J = 1 TO 2; 

IF (J EQ 1) THEN D2 = UD2; 

ELSE D2 = MD2; 

PDIF = 1.00; 

DO I = 1 BY 1; 

P = 1 - PR0BF(F,D1,D2); 
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DIF = ABS (P - ALPHA) ; 

IF (DIF GT PDIF) THEI^ GO TO A; 

PDIF = DIF; 

F = F + .001; 

END; 

A: F = F - .001; 

IF (J EQ 1) THEN UF = F; 

ELSE MF = F; 

END; 

KEEP MF UF ALPHA N K; 

OUTPUT; 

PPOC PRINT; 

PPDC MATRIX PRINT FUZZ; 
FETCH FS DATA = FISHER; 
UF = FS(1,4); 
MF = FS(1,5); 
ALPHA = FS(1,1); 
N= FS(1,2); 
K = FS(1,3); 
U = -.3108 / 

-.2004 / 

-.0524 / 

-.0564 / 

-.0536; * GENERATED DATA, 5 TRIALS, ONE GROUP, 

COLUMN VECTOR OF THE REP. MEAS. SAMPLE MEANS 

MK = (K * K ~ K) #/2; * THE NUMBER OF CORRELATIONS TO BE PLACED 

IN TRIAL 

* WE MUST FIRST PLACE ELEMENTS IN TFOAG BEFO^ IT CAN APPEAR ON 
THE LEFT HAND SIDE OF AN = SIGN 

TRIAG = J(MK,1,1) ; * PLACE MK ONE'S IN TRIAG 
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SlC3yiA = 1.2852 1.0553 .9928 1.0284 .682 / 
1.0553 1.1904 1.0677 1.098 .6788 / 
.9928 1.0677 1.0922 1.0315 .6786 / 
1.0284 1.098 1.0315 1.1795 .6921 / 
.682 .6788 .6786 .6921 .7122 ; 
VAR = DIAG(SI(3yPV); 
STD = SO^T (VAR) ; 
STDINV = INV(STD) ; 
COR = STDINV * SIO^ * STDINV; 

* PLACE THE LOWER TRIANGULAR HALF CF QOR INTO A \^,CICR (TRIAG) 

f 

CNT = 0; 

DO I = 1 TO K; 

DO J = 1 TO I; 

IF (I BQ J) THEN GO TO B; 

CNT = CNT + 1; 

TRIAG(CNT,1) =COR(I,J); 

B: END; 

END; 

* RANK ORDER THE OC»RELATIONS IN TRIAG 

• 

RJTRIAG = TRIAG; 

ATRIAG = RAI^ (TRIAG) ; 

TRIAG (RANK (TRIAG) , ) = RJTRIAG; 

OTRIAG = TRIAG 

* FIND THE MEDIAN OF THE VALUES IN TRIAG 

f 

MID = INT(MK #/ 2) ; 
MIDI = MID + 1; 

RMED = (TRIAG (MID, 1) + TRIAG (MIDI, 1) ) #/ 2; 
IF MnD(MK,2) EQ 0 THEN RMED = RMED; 

ELSE RMED - TRIAG (MIDI, 1) ; * THE MEDIAN OORREIATION 

* FIND THE AVERAGE CORRELATION IN TRIAG 



ERIC 



35 



I 



Power Analysis 
35 

PBAR = SUM(TRIAG) ^/ MK; * THE AVEI^AGE CDRREIATION; 
C = 1 0 0 0 -1 / 

0 10 0-1/ 

0 0 10-1/ 

0 0 0 1 -1; 

* NONSINGULAR MATRIX OF K - 1 BY K CONTRAST COEFFICIENTS 

t 

* REDEFINE THE TRANSFORMATION MATRIX C BY ORTHONORMALIZING THE 
COEFFICIENTS, GRAM-SCHMIDT a^THO^DRMALIZATION 

C = C; 

GS CTEMP T LINDEP C; 

C = CTEMP'; * ROW CBTHONCRMALIZED COTTRAST COEFFICIENTS 

SIG - C * SIO^ * C; 

EIGEN EVALS EVECS SIG; 
DETERM = DET(SIG); 
C = EVECS' * C; * THE RESULTANT C CONTAINS ORTHCNORMALIZED 

CONTRAST CCEFFICIENTS SUCH THAT C * SICm * 
C IS A DIAQCNAL MATRIX 

9 

CONTRAST = C * U; * ORTH0NCM1?UjIZED CONTRASTS ON THE REPEAIED 

MEASURES MEANS 

CCN2 = CONTRAST ##2; * SQUARED CONTRASTS, NEEDED FOR EFFECT 

SIZES 

SUM_0ON2 = SUM(C0N2) ; * SUM OF THE SQUARED CONTRASTS 

CON_VAR = C * SIO^ * C; * A DIAGONAL MATRIX v>n:TH THE CONTRAST 

VARIANCES ON THE DIAGONAL 
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CjON_VAR2 = C0N_V7^ * OONVAR; * DIAGONAL MATRIX WITH SQUARED 

VARIANCES ON THE DIAGONAL, USED 
10 CALOILATE GGI 

SSB = N * (U* * C * C * U) ; * S\M OF SQUARES BEIVTEEN MEASURES 

SSE = TRACE (O0N_VAR) ; * THE SUM (F THE CONTRAST VARIANCES IS 

THE SUM CF SQUARES ERRO^ 

SSE2 = TRACE (00N_VAR2) ; * SUM OF THE SQUARED VARIANCES, USED TO 

CALCULATE GGI 

VARJJXM = SSE #/ (K-1) ; * THE 1MER?-CTI0N VARIANCE, ALSO THE 

ERROR VARIANCE (BQ 3, 84) 

9 

VAR_M = TRACE (SIGMA) #/K; * THE ESTIMATE (POOLED ACROSS 

MEASURES) OF THE VARIANCE OF A 
SINGLE MEASURE 

9 

GGI = (SSE * SSE) #/ ( (K-1) * SSE2) ; * IHE GREENHOUSE GEISSER 

ESTIMATE OF SPHERICITY 
(EPSILON, ER 1, 84) 

9 

SSWRES = SSE * (N-1) ; * SUM OF SQUARES WITHIN PBOP'LE RESIDUAL 

AS FOUND IN RELIABILITY PROGRAM 

9 

SSWP = SSB + SSWRES; * SUM OF SQUARES WITHIN PEOPLE AS FOUND IN 

RELIABILITY PROGRAM 

9 

SSTOT = SSB + (VAR_M * ( (N * K) -K) ) ; * SUM OF SQUARES TOT^I 

9 

SSBP = SSTOT - SSWP; * SUM OF SQUARES BETWEEN PEOPLE AS POUND 

IN RELIABILITY PROGRAM 

9 

KINV = 1 #/ K; * ONE OVER K 
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INV_CV = INV(OON_VAR) ; * DIAQCNAL MATRIX WITH C3NE OVER THE 

CONTRAST VARIANCES ON THE DIAGONAL 

PATIO = INVj::V * 00N2; * VECTOR CONTAINING THE RATIOS OF THE 

CONTRASTS SQUARED TO THE CONTRAST 
VARIANCES 

MES_PCP = SQPT (KINV * SUM (RATIO) ); * MULTIVARIATE EFFECT SIZE, 

CONSIDERED AS THE C30LD 
STANDARD (EQ 1, 85) 

UES_POP = SQRT(((K-1) * SUM_C0N2) #/ (K * SSE) ) ; * UNIVARIATE 

EFFECT SIZE 
GOLD STANDARD 
(BQ 6, 85) 

MDELTA = N * K * MES_POP * MESJOP; * MULTIVARIATE 

IOnICENTRALITY PARAMETER, 
GOLD STANDARD 
(EQ 4, 85) 

9 

□DELTA = N * K * UES_POP * UES_POP; * UNIVARIATE NONCENTRALITY 

PARAMETER, GOLD STANDARD 
(BQ 4, 85) 

ONE_RBAR = 1 - REAR; * ONE MINUS THE MEAN CORRELATION 
ONE_RMED = 1 - RMED; * ONE MINUS THE MEDIAN CORRELATION 

ES_MEAN = SQRT ( (SSB #/ N) #/ (K * VAR_M * ONE_RBAR) ) ; * EFFECT 

SIZE 
BASED 
ON THE 
MEAN 
CORRELATION 
(EQ11,85) 
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ES_MED = SQf^ ( (SSB #/ N) #/ (K * VAR_M * ONE_RMED) ) ; * EFFECT 

SIZE 
BASED 
ON THE 
MEDIAN 
OOMIATION 
(EQ 11,85) 

MEAN_DEL = N * K * ESjyEAN * ESJCAN; * ASSUMIN3 UNIEX)FMITY, 

THE NONCENTRALITY 
PARANETER BASED ON THE 
AVERAGE QDRRELATION 
m 4, 85) 

MED_DEL = N * K * ES_NED * ES_NED; * ASSUMING UNIFC^MITY, THE 

NONCENTRALITY PARAMETER 
BASED ON THE MEDIAN 
OQRRELATION 
m 4, 85) 

DFl = K-l; * BOTH UNIVARIATE AND MULTIVARIATE NUMERATOR DEGREES 
OF FREEDOM 

UDF2 = (K-l) * (N-1); * UNIVARIATE DENOMINATOR DEGREES OF 

FREEDOM 

MDF2 = N - K + 1; * MULTIVARIATE DENOMINATOR DEGREES OF FREEDOM 

★ 

* PCWER FOR ALL EFFECT SIZES BASED ON THE 
MULTIVARIATE DEGREES OF FREEDOM 
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Dl = DFl; 
D2 = NDF2; 
F = MF; 
UT = DFl; 

V = MDF2; 
RLAM = MDELTA; 
LINK SEVZEL; 

MP0P__PO7 = PR!:B^DPM(PCW1) ; * MJLTIVARIATE POWER FOR THE GOLD 

STANDARD 

RLAM = MEANJDEL; 
LINK SEVZEL; 

MEAN_PCW = PRQBNCMl(POWl) ; * POWER BASED ON THE AVERAGE 

CORRELATION 

RLAM = MED_DEL; 
LINK SEVZEL; 

MED_PCW = PRCBNORM(PCWl) ; * POWER BASED ON THE MEDIAN 

OORRELATION 

★ : ^ ^ 

* POWER FCR ALL EFFECT SIZES BASED ON THE 
UNIVARIATE DEGREES CF FREEDOM 

Dl = DFl; 
D2 = TJDF2; 
F - UF; 
UT = DFl; 

V = UDF2; 
RLAM = UDELTA; 
LINK SEVZEL; 

UPOPJPCW = PRDBNDRM(POWl) ; * UNIVARIATE POWER FOR THE GOLD 

STANDARD 
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RLAM = MEAN_DEL; 
LINK SEVZEL; 

UMEANPCW = PROBNORM(POWl) ; * POWER BASED ON THE AVERAGE 

CORRELATION 

RLAM = MED_DEL; 
LINK SEVZEL; 

■JMED_PCW = PRCBNORM(POWl) ; * POWER BASED ON THE MEDIAN 

CORRELATION 

STOP; 



SE^/ZEL: 

* OT DEGREES OF FREEDCM FOR THE NUMERP.TOR OF THE F-TEST 

V DBP' EES CF FREEDCM FOR THE DFENOVIINATOR OF THE F-TEST 

RLAM—NONCENTRALITY PARAMETER 

F F VALUE REQUIRED FOR SIGNIFICANCE WITH UT AND V 

PCWl—SOORE RETURNED TO MAIN PROGRAM WHICH WHEN SENT TO 
PRQBNCy<M DETERMINES THE POWER 

f 

TEMPI = SQRT (2* (UT+RLAM) - (UT+2*RLAM) #/ (UT+RLAM) ) ; 

TE3yP2 = S(2^T ( ( (2*V ".) *UT*F) #/V) ; 

imP3 = SQRT ( (UT*F) #/V+ (UT+2*RLAM) #/ (UT+RLAM) ) ; 

POWl (TSMPl-THyiP2) #/TEMP3; 

RETURN; 



